Contents

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

Changes in This Release for Oracle Database Testing Guide

• Changes in Oracle Database 12c Release 1 (12.1)

1 Introduction to Oracle Database Testing

• 1.1 SQL Performance Analyzer
• 1.2 Database Replay
• 1.3 Test Data Management

Part I SQL Performance Analyzer

2 Introduction to SQL Performance Analyzer

• 2.1 Capturing the SQL Workload
• 2.2 Setting Up the Test System
• 2.3 Creating a SQL Performance Analyzer Task
• 2.4 Measuring the Pre-Change SQL Performance
• 2.5 Making a System Change
• 2.6 Measuring the Post-Change SQL Performance
• 2.7 Comparing Performance Measurements
• 2.8 Fixing Regressed SQL Statements

3 Creating an Analysis Task

• 3.1 Creating an Analysis Task Using Enterprise Manager
  • 3.1.1 Using the Parameter Change Workflow
  • 3.1.2 Using the Optimizer Statistics Workflow
  • 3.1.3 Using the Exadata Simulation Workflow
  • 3.1.4 Using the Guided Workflow
• 3.2 Creating an Analysis Task Using APIs
  • 3.2.1 Running the Exadata Simulation Using APIs
• 3.3 Remapping Multitenant Container Database Identifiers in an Analysis Task

4 Creating a Pre-Change SQL Trial

• 4.1 Creating a Pre-Change SQL Trial Using Enterprise Manager
• 4.2 Creating a Pre-Change SQL Trial Using APIs

5 Creating a Post-Change SQL Trial

• 5.1 Creating a Post-Change SQL Trial Using Oracle Enterprise Manager
• 5.2 Creating a Post-Change SQL Trial Using APIs

6 Comparing SQL Trials

• 6.1 Comparing SQL Trials Using Oracle Enterprise Manager
  • 6.1.1 Analyzing SQL Performance Using Oracle Enterprise Manager
  • 6.1.2 Reviewing the SQL Performance Analyzer Report Using Oracle Enterprise Manager
    • 6.1.2.1 Reviewing the SQL Performance Analyzer Report: General Information
    • 6.1.2.2 Reviewing the SQL Performance Analyzer Report: Global Statistics
    • 6.1.2.3 Reviewing the SQL Performance Analyzer Report: Global Statistics Details
    • 6.1.2.4 About SQL Performance Analyzer Active Reports
  • 6.1.3 Tuning Regressed SQL Statements Using Oracle Enterprise Manager
    • 6.1.3.1 Creating SQL Plan Baselines
    • 6.1.3.2 Running SQL Tuning Advisor
• 6.2 Comparing SQL Trials Using APIs
  • 6.2.1 Analyzing SQL Performance Using APIs
  • 6.2.2 Reviewing the SQL Performance Analyzer Report in Command-Line
    • 6.2.2.1 General Information
    • 6.2.2.2 Result Summary
    • 6.2.2.3 Result Details
  • 6.2.3 Comparing SQL Tuning Sets Using APIs
  • 6.2.4 Tuning Regressed SQL Statements Using APIs
  • 6.2.5 Tuning Regressed SQL Statements From a Remote SQL Trial Using APIs
  • 6.2.6 Creating SQL Plan Baselines Using APIs
  • 6.2.7 Using SQL Performance Analyzer Views

7 Testing a Database Upgrade

• 7.1 Upgrading from Oracle9i Database and Oracle Database 10g Release 1
  • 7.1.1 Enabling SQL Trace on the Production System
  • 7.1.2 Creating a Mapping Table
  • 7.1.3 Building a SQL Tuning Set
  • 7.1.4 Testing Database Upgrades from Oracle9i Database and Oracle Database 10g Release 1
    • 7.1.4.1 Testing Database Upgrades from Releases 9.x and 10.1 Using Cloud Control
    • 7.1.4.2 Testing Database Upgrades from Releases 9.x and 10.1 Using APIs
• 7.2 Upgrading from Oracle Database 10g Release 2 and Newer Releases
  • 7.2.1 Testing Database Upgrades from Oracle Database 10g Release 2 and Newer Releases
    • 7.2.1.1 Testing Database Upgrades from Releases 10.2 and Higher Using Cloud Control
    • 7.2.1.2 Testing Database Upgrades from Releases 10.2 and Higher Using APIs
• 7.3 Tuning Regressed SQL Statements After Testing a Database Upgrade

Part II Database Replay

8 Introduction to Database Replay

• 8.1 Workload Capture
• 8.2 Workload Preprocessing
• 8.3 Workload Replay
• 8.4 Analysis and Reporting

9 Capturing a Database Workload

• 9.1 Prerequisites for Capturing a Database Workload
• 9.2 Setting Up the Capture Directory
• 9.3 Workload Capture Options
  • 9.3.1 Restarting the Database
  • 9.3.2 Using Filters with Workload Capture
• 9.4 Workload Capture Restrictions
• 9.5 Enabling and Disabling the Workload Capture Feature
• 9.6 Enterprise Manager Privileges and Roles
  • 9.6.1 Database Replay Viewer Role
  • 9.6.2 Database Replay Operator Role
• 9.7 Capturing a Database Workload Using Enterprise Manager
• 9.8 Capturing Workloads from Multiple Databases Concurrently
• 9.9 Monitoring Workload Capture Using Enterprise Manager
  • 9.9.1 Monitoring an Active Workload Capture
  • 9.9.2 Stopping an Active Workload Capture
  • 9.9.3 Viewing a Completed Workload Capture
• 9.10 Capturing a Database Workload Using APIs
  • 9.10.1 Defining Workload Capture Filters
  • 9.10.2 Starting a Workload Capture
  • 9.10.3 Stopping a Workload Capture
  • 9.10.4 Exporting AWR Data for Workload Capture
  • 9.10.5 Importing AWR Data for Workload Capture
• 9.11 Monitoring Workload Capture Using Views

10 Preprocessing a Database Workload

• 10.1 Preparing a Single Database Workload Using Enterprise Manager
  • 10.1.1 Creating a Database Replay Task
  • 10.1.2 Creating a Replay from a Replay Task
  • 10.1.3 Preparing the Test Database
  • 10.1.4 Preprocessing the Workload and Deploying the Replay Clients
• 10.2 Preprocessing a Database Workload Using APIs
  • 10.2.1 Running the Workload Analyzer Command-Line Interface

11 Replaying a Database Workload

• 11.1 Setting Up the Test System
  • 11.1.1 Restoring the Database
  • 11.1.2 Resetting the System Time
• 11.2 Steps for Replaying a Database Workload
  • 11.2.1 Setting Up the Replay Directory
  • 11.2.2 Resolving References to External Systems
  • 11.2.3 Connection Remapping
  • 11.2.4 User Remapping
  • 11.2.5 Specifying Replay Options
    • 11.2.5.1 Preserving COMMIT Order
    • 11.2.5.2 Controlling Session Connection Rate
    • 11.2.5.3 Controlling Request Rate Within a Session
  • 11.2.6 Using Filters with Workload Replay
  • 11.2.7 Setting Up Replay Clients
    • 11.2.7.1 Calibrating Replay Clients
    • 11.2.7.2 Starting Replay Clients
    • 11.2.7.3 Displaying Host Information
• 11.3 Replaying a Database Workload Using Enterprise Manager
• 11.4 Monitoring Workload Replay Using Enterprise Manager
  • 11.4.1 Monitoring an Active Workload Replay
  • 11.4.2 Viewing a Completed Workload Replay
• 11.5 Replaying a Database Workload Using APIs
  • 11.5.1 Initializing Replay Data
  • 11.5.2 Remapping Connections
  • 11.5.3 Remapping Users
  • 11.5.4 Setting Workload Replay Options
  • 11.5.5 Defining Workload Replay Filters and Replay Filter Sets
    • 11.5.5.1 Adding Workload Replay Filters
    • 11.5.5.2 Deleting Workload Replay Filters
    • 11.5.5.3 Creating a Replay Filter Set
    • 11.5.5.4 Using a Replay Filter Set
  • 11.5.6 Setting the Replay Timeout Action
  • 11.5.7 Starting a Workload Replay
  • 11.5.8 Pausing a Workload Replay
  • 11.5.9 Resuming a Workload Replay
  • 11.5.10 Cancelling a Workload Replay
  • 11.5.11 Exporting AWR Data for Workload Replay
  • 11.5.12 Importing AWR Data for Workload Replay
• 11.6 Monitoring Workload Replay Using APIs
  • 11.6.1 Retrieving Information About Diverged Calls
  • 11.6.2 Monitoring Workload Replay Using Views

12 Analyzing Captured and Replayed Workloads

• 12.1 Using Workload Capture Reports
  • 12.1.1 Accessing Workload Capture Reports Using Enterprise Manager
  • 12.1.2 Generating Workload Capture Reports Using APIs
  • 12.1.3 Reviewing Workload Capture Reports
• 12.2 Using Workload Replay Reports
  • 12.2.1 Accessing Workload Replay Reports Using Enterprise Manager
  • 12.2.2 Generating Workload Replay Reports Using APIs
  • 12.2.3 Reviewing Workload Replay Reports
• 12.3 Using Replay Compare Period Reports
  • 12.3.1 Generating Replay Compare Period Reports Using APIs
  • 12.3.2 Reviewing Replay Compare Period Reports
    • 12.3.2.1 General Information
    • 12.3.2.2 Replay Divergence
    • 12.3.2.3 Main Performance Statistics
    • 12.3.2.4 Top SQL/Call
    • 12.3.2.5 Hardware Usage Comparison
    • 12.3.2.6 ADDM Comparison
    • 12.3.2.7 ASH Data Comparison
• 12.4 Using SQL Performance Analyzer Reports
  • 12.4.1 Generating SQL Performance Analyzer Reports Using APIs

13 Using Workload Intelligence

• 13.1 Overview of Workload Intelligence
  • 13.1.1 About Workload Intelligence
  • 13.1.2 Use Case for Workload Intelligence
  • 13.1.3 Requirements for Using Workload Intelligence
• 13.2 Analyzing Captured Workloads Using Workload Intelligence
  • 13.2.1 Creating a Database User for Workload Intelligence
  • 13.2.2 Creating a Workload Intelligence Job
  • 13.2.3 Generating a Workload Model
  • 13.2.4 Identifying Patterns in a Workload
  • 13.2.5 Generating a Workload Intelligence Report
• 13.3 Example: Workload Intelligence Results

14 Using Consolidated Database Replay

• 14.1 Use Cases for Consolidated Database Replay
  • 14.1.1 Database Consolidation Using Pluggable Databases
  • 14.1.2 Stress Testing
  • 14.1.3 Scale-Up Testing
• 14.2 Steps for Using Consolidated Database Replay
  • 14.2.1 Capturing Database Workloads for Consolidated Database Replay
    • 14.2.1.1 Supported Types of Workload Captures
    • 14.2.1.2 Capture Subsets
  • 14.2.2 Setting Up the Test System for Consolidated Database Replay
  • 14.2.3 Preprocessing Database Workloads for Consolidated Database Replay
  • 14.2.4 Replaying Database Workloads for Consolidated Database Replay
    • 14.2.4.1 Defining Replay Schedules
    • 14.2.4.2 Remapping Connections for Consolidated Database Replay
    • 14.2.4.3 Remapping Users for Consolidated Database Replay
    • 14.2.4.4 Preparing for Consolidated Database Replay
    • 14.2.4.5 Replaying Individual Workloads
  • 14.2.5 Reporting and Analysis for Consolidated Database Replay
• 14.3 Using Consolidated Database Replay with Enterprise Manager
• 14.4 Using Consolidated Database Replay with APIs
  • 14.4.1 Generating Capture Subsets Using APIs
  • 14.4.2 Setting the Replay Directory Using APIs
  • 14.4.3 Defining Replay Schedules Using APIs
    • 14.4.3.1 Creating Replay Schedules Using APIs
    • 14.4.3.2 Adding Workload Captures to Replay Schedules Using APIs
    • 14.4.3.3 Adding Schedule Orders to Replay Schedules Using APIs
    • 14.4.3.4 Saving Replay Schedules Using APIs
  • 14.4.4 Running Consolidated Database Replay Using APIs
    • 14.4.4.1 Initializing Consolidated Database Replay Using APIs
    • 14.4.4.2 Remapping Connection Using APIs
    • 14.4.4.3 Remapping Users Using APIs
    • 14.4.4.4 Preparing for Consolidated Database Replay Using APIs
    • 14.4.4.5 Starting Consolidated Database Replay Using APIs
• 14.5 Example: Replaying a Consolidated Workload with APIs

15 Using Workload Scale-Up

• 15.1 Overview of Workload Scale-Up
  • 15.1.1 About Time Shifting
  • 15.1.2 About Workload Folding
  • 15.1.3 About Schema Remapping
• 15.2 Using Time Shifting
• 15.3 Using Workload Folding
• 15.4 Using Schema Remapping

Part III Test Data Management

16 Data Discovery and Modeling

• 16.1 Creating an Application Data Model
• 16.2 Managing Sensitive Column Types
• 16.3 Associating a Database to an Application Data Model
• 16.4 Importing and Exporting an Application Data Model
  • 16.4.1 Importing an ADM
  • 16.4.2 Exporting an ADM
• 16.5 Verifying or Upgrading a Source Database
• 16.6 Using Self Update to Download the Latest Data Masking and Test Data Management Templates

17 Data Subsetting

• 17.1 About Inline Masking and Subsetting
• 17.2 Creating a Data Subset Definition
  • 17.2.1 Generating a Subset Script
  • 17.2.2 Saving a Subset Script
• 17.3 Importing and Exporting Subset Templates and Dumps
  • 17.3.1 Importing a Subset Definition
  • 17.3.2 Exporting a Subset Definition
• 17.4 Creating a Subset Version of a Target Database
• 17.5 Inline Masking and Subsetting Scenarios

18 Masking Sensitive Data

• 18.1 Overview of Oracle Data Masking
  • 18.1.1 Data Masking Concepts
  • 18.1.2 Security and Regulatory Compliance
  • 18.1.3 Roles of Data Masking Users
  • 18.1.4 Related Oracle Security Offerings
  • 18.1.5 Agent Compatibility for Data Masking
  • 18.1.6 Supported Data Types
• 18.2 Format Libraries and Masking Definitions
• 18.3 Recommended Data Masking Workflow
• 18.4 Data Masking Task Sequence
• 18.5 Defining Masking Formats
  • 18.5.1 Creating New Masking Formats
    • 18.5.1.1 Providing User-defined and Post-processing Functions
    • 18.5.1.2 Using Masking Format Templates
  • 18.5.2 Using Oracle-supplied Predefined Masking Formats
    • 18.5.2.1 Patterns of Format Definitions
    • 18.5.2.2 Category Definitions
    • 18.5.2.3 Installing the DM_FMTLIB Package
  • 18.5.3 Providing a Masking Format to Define a Column
  • 18.5.4 Deterministic Masking Using the Substitute Format
• 18.6 Masking with an Application Data Model and Workloads
  • 18.6.1 Adding Dependent Columns
  • 18.6.2 Masking Dependent Columns for Packaged Applications
  • 18.6.3 Selecting Data Masking Advanced Options
    • 18.6.3.1 Data Masking Options
    • 18.6.3.2 Random Number Generation
    • 18.6.3.3 Pre- and Post-mask Scripts
  • 18.6.4 Cloning the Production Database
  • 18.6.5 Importing a Data Masking Template
• 18.7 Masking a Test System to Evaluate Performance
  • 18.7.1 Using Only Masking for Evaluation
  • 18.7.2 Using Cloning and Masking for Evaluation
• 18.8 Upgrade Considerations
• 18.9 Using the Shuffle Format
• 18.10 Using Group Shuffle
• 18.11 Using Conditional Masking
• 18.12 Using Data Masking with LONG Columns

Index